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Abstract 

What does it mean to claim that a physical or natural system computes? 
One answer, endorsed here, is that computing is about programming 
a system to behave in different ways. This paper offers an account of 
what it means for a physical system to compute based on this notion. 
It proposes a behavioural characterisation of computing in terms of a 
measure of programmability, which reflects a system's ability to react to 
external stimuli. The proposed measure of programmability is useful for 
classifying computers in terms of the apparent algorithmic complexity of 
their evolution in time. I make some specific proposals in this connection 
and discuss this approach in the context of other behavioural approaches, 
notably Turing's test of machine intelligence. I also anticipate possible 
objections and consider the applicability of these proposals to the task of 
relating abstract computation to nature-like computation. 

Keywords: Turing test; computing; nature-like computation; dynamic be- 
haviour; algorithmic information theory; computationalism. 

Faced with the question of computation, it may be tempting to go along with 
the formal mathematical position and simply invoke Turing's model. This pa- 
per doesn't need to do this, though its author couldn't be more wholehearted in 
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granting the beauty and generality of the universal Turing machine model, which, 
it will be argued, is also a natural foundation for unconventional (and natural) 
computation. 

To date the study of the limits of computation has succeeded in offering us 
great insight into this question. The borderline between decidability and undecid- 
ability has provided an essential intuition in our search for a better understand- 
ing of computation. One can, however, wonder just how much can be expected 
from such an approach, and whether other, alternative approaches to understand- 
ing computation may complement the knowledge and intuition it affords, espe- 
cially in modern uses of the concept of computation, where objects or events are 
seen as computations in the context of physics. 

One such approach involves not the study of systems lying "beyond" the un- 
computable limit (the "Turing limit"), but rather systems at the farthest reaches 
of the computable, in other words the study of the minimum requirements for 
universal computation. How easy or complicated is it to assemble a machine 
that is Turing universal? This minimalistic bottom-up approach is epitomised by 
Wolfram's programme ll38l in its quest to study simple programs, a programme 
initiated by Minsky [23J and to which several authors have contributed (see ll39ll 
for an excellent survey). The underlying question is how pervasive and ubiqui- 
tous the computational property of universality is in computational and natural 
systems. From the various results concerning small universal computing systems, 
we now know that generating universality takes very little, indeed that it seems 
to be the case that it is more difficult to design a non-trivial non-Turing-complete 
computer language than a Turing-complete one. Thus it seems natural to believe 
that computation and universality are not exclusive to digital computers. 

This paper is organised as follows. In Section [T| the foundations of natural 
computation are discussed, taking as a starting point Turing's case — argued in 
relation to digital computation — for the disembodied essence of natural computa- 
tion. In Section [2} the behavioural approach to natural computation will be intro- 
duced, based on notions of algorithmic complexity, and with an analogy drawn 
between it and Turing's pragmatic approach to machine intelligence. In Sec- 
tion |3j a characterisation and taxonomy of computation (and of computers) based 
on the compression-based approximation of a system's algorithmic complexity is 
advanced and, finally, in Section|4]possible objections are analysed, also in light of 
the way in which they can be transferred between Turing's test and the definition 
of nature-like computation adopted herein. 
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1 A classical foundation for unconventional compu- 
tation 



A compiler written between computational systems, hence a mapping between 
symbols and states, is the usual way of proving in a technical fashion that one 
system is equivalent to another in computational power (hence that it computes). 
A legitimate question that arises is whether we need this technical apparatus to 
define computation. The problem can be phrased in the words of M. Conrad 
In the real world, little if anything is known of the primitive operations or symbols 
of a system. 

One strong criticism of the idea that natural objects (including the universe) 
compute is that the question and answer become meaningless, as it is hard to see 
how any physical system would not be computational [|28l[3T| . One concept that 
Turing did not advance (although he suggested taking into account the percentage 
of people acknowledging the success or failure of his machine intelligence test 
113710 . but that is very much in the spirit of another of his seminal contributions 
(the relativisation of computation, in his notion of degrees of computation |j3~6lD . 
is a metric of intelligence, one where passing or failing is beside the point, but 
which tells us how close or far we are from intelligent behaviour. 

This paper advances a metric of approximative, asymptotic and limit be- 
haviour, not for intelligence, but for computation, one that identifies objects to 
which some degree of computation can be assigned on the basis of how they 
behave, and particularly on the basis of whether they can be programmed. It 
thereby places programmability at the centre of our definition of computation and 
so avoids representationalism. 

1.1 A behavioural approach to computation 

Among the most important of Turing's contributions to AI was his test of ma- 
chine intelligence ll371 . devised as a response to the question of whether computers 
could think. The Turing test is a pragmatic behavioural approach to the problem 
of assigning intelligence to objects (see Fig. |1.1[ ). In the spirit of Turing, one may 
ask whether objects other than electronic computers compute, in particular natural 
objects and natural processes. This question ultimately leads to the more general 
question of whether the universe itself computes (also known as "pancomputa- 
tionalism"), and if so how. Some speculative answers have been given, but in this 
presentation we take a more pragmatic and behavioural approach to the question, 
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in the spirit of Turing's approach to intelligence. 
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Figure 1: The basic elements of Turing's test of intelligence. 



When Alan Turing was thinking about AI he believed "that in about fifty years' 
time it will be possible to programme computers, with a storage capacity of about 
10 9 , to make them play the imitation game so well that an average interrogator 
will not have more than a 70 percent chance of making the right identification 
after five minutes of questioning. ... I believe that at the end of the century the 
use of words and general educated opinion will have altered so much that one will 
be able to speak of machines thinking without expecting to be contradicted." 

Most would agree that Turing's faith hasn't exactly been vindicated, perhaps 
because of the way in which the definition of intelligence has changed over time, 
indeed every time that some task requiring intelligence has been successfully ex- 
ecuted by a computing machine, from crunching numbers faster than humans to 
faring better at chess, and more recently, performing some rather complicated 
games on TV shows. I think we live in a time where it has finally become com- 
mon practice to treat objects other than electronic and human computers as com- 
puting objects, and so I shall address the ineluctable generalisation of the concept 
of computation beyond the realm of digital computers, and more specifically its 
extension to natural systems. If Turing's claim were to be revised, with objects 
computing being substituted for "machines thinking", the prediction seems right 
on target: "I believe that at the end of the century the use of words and general 
educated opinion will have altered so much that one will be able to speak of [all 
kinds of objects computing] without expecting to be contradicted." 



4 



1.2 Digital computation as natural computation 

Turing's most important contribution to science is his definition of universal com- 
putation, integral to his attempt to mechanise the concept of a computing machine. 
A universal (Turing) machine is an abstract device capable of carrying out any 
computation for which an instruction can be written. More formally, given a fixed 
description of Turing machines, we say that a Turing machine U is universal if for 
any input s and Turing machine M, U((M), s) halts if M halts on s and outputs 
M(s); and does not halt if M(s) does not (where (M) means the codification of 
M in bits so that it can be fed to a Turing machine U that accepts binary inputs). 
In other words, U is capable of running any Turing machine M with input s. 

The fact that we need hardware and software is an indication that we need 
a programmable substratum that can be made to compute something for us, but 
Turing's main contribution vis-a-vis the concept of computational universality is 
that data and programs can be stored together in a single memory without any fun- 
damental distinction. One can always write a specific-purpose machine with no 
input to perform any computation, and one can always write a program describing 
that computation as the input for a (universal) Turing machine, so in a sense there 
is a non-essential distinction between program and data. 

It is clear that one can derive a fundamental kind of natural computation from 
Alan Turing's seminal concept of universal computation. Turing points out [37J 
that given that Babbage's computer did not use electrical power, and that because 
Babbage's and all digital computers are in some fundamental sense equivalent, 
electricity cannot be a fundamental property of computation. Neither is it the car- 
rier. In other words, Turing universality disembodies computation, uncoupling it 
from any physical substratum. This doesn't mean that one can carry out computa- 
tions without physical elements, but rather that the nature of the physical elements 
is not very relevant except insofar as it bears upon the (important) question of re- 
sources (capacity, speed). A programmer uses memory space and cpu cycles in a 
regular computer to perform a computation, but this is by no means an indication 
that computation requires a computer (say a PC), only that it needs a substratum. 
The behaviour of the substratum is the underlying property that makes something 
a computation. 

The main difference between a digital electronic computer and a natural sys- 
tem that possibly computes, is that the former was designed for the purpose, and 
hence one can easily identify all its elements and have recourse to them when es- 
tablishing a definition of computation. For natural systems, however, there is little 
hope that even if their elements were to be identified, one could define their states 
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in a way that captured all their convolutions well enough to establish that they 
possessed some property of computation. This situation is not that different from 
the undecidability of the halting problem, but it is in some sense more general. For 
digital computation, the undecidability of the halting problem means that if one 
wished to know whether a computation would eventually halt, one would have no 
other option than to run it and wait and see (possibly for an infinite length of time). 
In natural systems, the halting problem is closer to the reachability problem, that 
is, the question of whether a system will reach a certain configuration. By reduc- 
tion to the halting problem, this can also be proven to be undecidable. The halting 
and reachability problems are in a strong sense behavioural and subjective in na- 
ture, as the behaviour of a system has to be determined by waiting, witnessing and 
recording it so that it can be understood in retrospect. If for Turing machines M, 
the function that computes M cannot in general be found, there is little hope of 
ever finding or even defining the function of a natural system. Hence one has to 
give up on trying to define computation for natural systems using elements such 
as states or functions. 

We know that systems that nobody ever designed as computers are able to 
perform universal computation, for example Wolfram's Rule 110 ll38l l6ll (in the 
rulespace of the so-called elementary cellular automata [38]), and that this, like 
other remarkably simple systems, is capable of universal computation (e.g. Con- 
way's game of Life [|2) or Langton's ant [fT9ll ). These systems may be said to 
readily arise physically, not having been deliberately designed. There is, how- 
ever, no universal agreement as regards the definition of what a computer may 
or may not be, or as to what exactly a computation might be, even though what 
computation is and what a computer is are well grasped on an intuitive level. 

Now we would like a concept of computation associated with natural and 
physical phenomena that we can measure and build on. We want a metric of 
computation that allows us to identify what is a computer and what is not. We 
want to be able to distinguish what computes from what does not. And we want a 
metric that we can use. 

2 A Turing test-inspired approach to computation 

As for Turing's test of intelligence, where one needs to accept that humans think 
if the test is to make sense, the reader must first accept that digital computation 
is performed in nature and that nature is capable of digital computation, even if 
only by the digital computers constructed by humans for precisely such a (gen- 
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eral) purpose. Human behaviour is to the Turing test what digital computation is 
to this behavioural approach to natural computation. The argument can be ren- 
dered more succinctly thus: Electronic computers compute, electronic computers 
are physical objects, physical objects are part of the universe, a part of the uni- 
verse is therefore capable of computation. Computers can be seen as the result of 
the re-programming of a part of the universe to make it compute what we want 
it to compute. This means that the question is not exactly whether the universe 
is capable of digital computation but rather whether the universe only performs 
computation, and if so, what kind of computation. I aim to provide a behavioural 
definition of computation that admits a wider definition of the notion of 'compu- 
tation'. Notice that I am replacing the question of whether a system is capable of 
digital computation with the question of whether a system can behave like a digi- 
tal computer and whether a digital computer can exhibit the behaviour of a natural 
system. So the approach is still classical in this sense, but purposely neutral with 
regard to the ontological issue. Also notice again the similarity with Turing's 
approach to machine intelligence. Turing chose to sometimes speak of "imita- 
tion" instead of "behaviour". "Imitation", however, seems to carry connotations 



of intentionality (see Subsection 4.2.3 ), and I am not very comfortable with the 
suggestion that a natural system may have a will to, or may purposefully imitate 
another system, especially if it is forced to do so artificially (although imitation is 
quite common in nature, where, for example, some animals mimic the behaviour 
of other animals to avoid being preyed upon). 

To make sense of the term "computation" in the contexts I'm interested in 
(modern views of physics), I propose a behavioural notion of nature-like compu- 
tation (similar in spirit to the coinage "physics-like computation" ||29ll33l ) that is 
compatible with digital computation but meaningful in broader contexts, indepen- 
dent of representations and possible carriers. This will require a measure of the 
degree of programmability of a system based on a compressibility index which 
is ultimately rooted in the concept of algorithmic complexity. I ask whether two 
computations are the same if they look the same and I try to answer with a specific 
tool possessing the potential to capture a notion of qualitative behaviour. 

In [|9l, a similar approach, but this time to the question of life, is audaciously 
put forward, also in the spirit of Turing's test. The idea is to recognise living 
systems by the way they behave and communicate through the signals transmitted 
between biological cells. This approach uses a biological interrogator to ask not 
what life is but rather when an artificial cell can be said to be alive. 

The behavioural approach takes Turing's disembodied concept of universal 
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Turing test for 
intelligence B37I 


Turing test for life J9J 


Turing test for 
computation 


Imitated property 


Thought 


Cellular functions 


Programmability 


Subjects 
in question 


Computing 
machines 


Biological and artificial 
cells 


any object 


Embodiment of 
property 


Human 
intelligence 


Biological life 
(metabolism, evolution, etc) 


Digital 
computers 


Probing 
mechanism 


Questions/answers 
mediated by natural 
language 


Questions/answers mediated 
by physicochemical 
language (chemical 
potentials, mechanical, 
transduction, signalling, etc.) 


Behavioural evaluation 
(sensitivity to external 
stimuli, behavioural 
differences, etc.) 
mediated by a lossless 
compression algorithm. 



Table 1: Comparison of Turing tests for intelligence, life [9] and computation. 



computation independent of substratum to its logical limit, its central question 
being whether one can program a system to behave in a desired way. This is again 
close to Turing's test in which the interrogator cannot directly see the individual 
replying, because intelligence is not a property that requires the possessor to have 
a "skin" (in the words of Turing himself 11371 ), for example, or to be a human being 
for that matter (Turing's approach), just as computation doesn't require electricity, 
or for that matter a digital computer (this approach). This approach that bases 
itself on the extent to which a system can be programmed tells us to what degree 
a given system resembles a computer. As the interrogator we will use a lossless 
compression algorithm that manifests properties of an observer, such as some type 
of subjectivity and finite resources. As suggested by Sutner 11331 . it is reasonable to 
require that any definition of computation in the general sense, rather than being a 
purely logical description (e.g. in terms of recursion theory), should capture some 
sense of what a physical computation might be. Sutner adds "A physical system 
is not intrinsically a computer, rather it is necessary to interpret certain features 
of the physical system as representing a computation." This obliges Sutner to take 
into consideration the observer and the act of interpretation of a physical system. 

In many ways, this account of computation can be derived from the negation 
of Piccinini's 4th. feature (the wrong things do not compute) ll27l . which I think 
is dogmatic and gets in the way of the extension of the notion of computation to 
cover natural computation. Among the things that Piccinini rules out as objects 
that possibly compute are planetary systems, hurricanes and digestive systems. In 
fact, Piccinini himself seems to have some difficulty ( E71 . p. 508) justifying how 
a digestive system is not computational. For insofar as a legitimate mechanistic 
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account can be given of a digestive system, that would mean that it possesses pre- 
cisely the sorts of properties and components that are taken into consideration in 
determining whether or not a system counts as a computer. I will argue that one 
doesn't need to axiomatically rule out such systems as computing or not. I will 
avoid making claims about whether or not such systems compute, because the 
approach advanced herein is above all a pragmatic approach designed to have ap- 
plications (in fact it was first developed as a tool for the investigation of dynamical 
properties of computer programs and not primarily as a philosophical account). 

On the other hand, the behavioural account defended herein does satisfy Pic- 
cinini's 3rd requirement (the right things compute). Piccinini's requirements 
2 (Explanation) and 6 (Taxonomy) are at the core of this proposal connecting 
programmability and computation and providing a grading system based on be- 
haviour. Piccinini's requirement 5 (Miscomputation) doesn't seem very relevant to 
this proposal, and even if it were, to this author this feature doesn't seem essential 
to computation, for it is hard to see how a computational system can miscompute 
other than in the eyes of the observer. Indeed Piccinini himself sees this as trou- 
blesome in an account of computation, as it violates requirement 1 . In fact, weak 
(i.e. observer dependent) miscomputation is pervasive in nature; I think nature 
amply manifests this kind of "miscomputation". In summary, I reject requirement 

1 (the basis of Piccinini's account), satisfy requirements 2, 3, and 6, particularly 

2 and 6 at which I think this proposal excels. And concerning requirement 4, 1 re- 
main neutral, not to say unconvinced, although I can acknowledge a form of weak 
miscomputation, that is a computation that does not go in the way the observer 
expects it to. This approach allows a taxonomy of computation. 

2.1 Algorithmic complexity as an approximative measure of 
programmability 

The traditional connection between behaviour and computation has tended toward 
explaining behaviour as computation [fTTl or computation as emulating brain ac- 
tivity [1221 . but this author has no knowledge of explorations in the direction of 
explaining computation as behaviour. 

This paper proposes an alternative behavioural definition of computation 
based on whether a system is capable of reacting to the environment — the input — 
as reflected in a measure of programmability . This will be done by using a phase 
transition coefficient previously defined in an attempt to characterise the evolution 
of cellular automata and other systems. This transition coefficient measures the 
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sensitivity of a system to external stimuli and will be used to define the suscepti- 
bility of a system to being (efficiently) programmed, in the context of a nature-like 
definition of computation. 

Turing's observer is replaced by a lossless compression algorithm, which has 
subjective qualities just like a regular observer, in that it can only partially "see" 
regularities in data, there being no perfectly effective compression algorithm in 
existence. The compression algorithm will look at the evolution of a system and 
determine, by means of feeding the system with different initial conditions (which 
is analogous to questioning it), whether it reacts to external stimuli. 

The compressed version of the evolution of a system is an approximation of 
its algorithmic (Kolmogorov) complexity defined by ITT81 : 

K T (s) = mxn{\p\,T(p) = s} 

That is, the length of the shortest program p that outputs the string s running 
on a universal Turing machine T) [fT8l ffl. A technical inconvenience of K as a 
function taking s to be the length of the shortest program that produces s is its 
non-computability, proven by reduction to the halting problem. In other words, 
there is no program which takes a string s as input and produces the integer K(s) 
as output. This is usually taken to be a major problem, but one would expect 
a universal measure of complexity to have such a property. The measure was 
first conceived to define randomness and is today the accepted objective mathe- 
matical measure of complexity, among other reasons because it has been proven 
to be mathematically robust (in that it represents the convergence of several in- 
dependent definitions). The mathematical theory of randomness has proven that 
properties of random objects can be captured by non-computable measures. One 
can, for example, approach K using lossless compression algorithms that detect 
regularities in order to compress data. The value of the compressibility method is 
that the compression of a string as an approximation to K is a sufficient test of 
non-randomness. If the shortest program producing s is larger than \s\ the length 
of s, then s is considered to be random. 

Based on the principles of algorithmic complexity, one can use the result of 
the compression algorithms applied to the evolution of a system to characterise the 
behaviour of the system [40] by comparing it to its uncompressed evolution. If the 
evolution is too random, the compressed version won't be much shorter than the 
length of the original evolution itself. It is clear that one can characterise systems 
by their behaviour [|40l : if they are compressible they are simple, otherwise they 
are complex (random-looking). The approach can be taken further and used to 
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detect phase transitions, as shown in [40|, for one can detect differences between 
the compressed versions of the behaviour of a system for different initial configu- 
rations. This second measure allows us to characterise systems by their sensitivity 
to the environment: the more sensitive the greater the variation in length of the 
compressed evolutions. A classification places at the top systems that can be con- 
sidered to be both efficient information carriers and highly programmable, given 
that they react succinctly to input perturbations. Systems that are too perturbable, 
however, do not show phase transitions and are grouped as inefficient information 
carriers. The efficiency requirement is to avoid what is known as Turing tarpits 
ll26ll . that is, systems that are capable of universal computation but are actually 
very hard to program. This means that there is a difference between what can be 
achieved in principle and the practical ability of a system to perform a task. This 
approach is therefore sensitive to the practicalities of programming a system rather 
than to its potential theoretical capability of being programmed. What if, instead 
of trying to draw a crystal clear line between what is and is not a computer, one 
were to define a measure of (" ' computedness")! I propose the following approach 
as a first approximation to programmability . 

Let C be an approximation to K (given that K is non-computable) by any 
means, for example, by using lossless compression algorithms or using the cod- 
ing theorem technique we presented in lfT2l . Let's define the function / as the 
variability of a system M as the result of fitting a curve <p (by (linear) regres- 
sion analysis) to the data points produced by different runs of increasing time 
t' (for fixed n) up to a given time t, of the sums of the differences in length of 
the approximations to Kolmogorov complexity (C) of a system M for inputs ij, 
j G {1, . . . , n} e E, divided by t(n — 1) (for the sole purpose of normalising 
the measure by the system's "volume," so that one can roughly compare different 
systems for different n and different t). With E an enumeration of initial inputs 
for M. The following expression is a more formal attempt to capture t compressed 
lengths of M for different initial conditions ij. M t (i) is a system M running for 
time t and initial input configuration i. At the limit C" captures the behaviour 
of M t for t — > oo, but the value of C" depends on the choices of t and n (we 
may sometimes refer to C as assuming a certain t and n), so one can only aim to 
capture some average or asymptotic behaviour, if any (because no convergence is 
guaranteed). C" is, however, an indicator of the degree of programmability of a 
system M relative to its external stimuli (input i). The larger the derivative, the 
greater the variation in M, and hence in the possibility of programming M to per- 
form a task or transmit information at a rate captured by C" itself (that is, whether 
for a small set of initial configurations M produces a single significant change or 
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does so incrementally). Now the second step is to define the asymptotic measure, 
that is the derivative of / with respect to time, as a system's programmability (first 
basic definition): 

For example, as is shown in Il40ll . certain elementary cellular automata rules 
that are highly sensitive to initial conditions and present phase transitions which 
dramatically change their qualitative behaviour when starting from different ini- 
tial configurations can be characterised by these qualitative properties. A further 
investigation of the relation between this transition coefficient and the computa- 
tional capabilities of certain known (Turing) universal machines has been under- 
taken in Il42l . We will refrain from exact evaluations of C to avoid distracting the 
reader with numerical approximations that may detract from our particular goal in 
this paper. Other calculations have been advanced in [43] and p4|. 

2.2 A behavioural approach to computation 

The following are first approaches to definitions connected to the qualitative 
behaviour of computational systems: 

Approximate variability (the number of possible different evolutions of a 
system): Let U\, U2, ... be an enumeration of inputs to a system M. We are 
interested in the question of how different the evolution of M(Ui) is to the 
evolution of M(Uj), in particular the maximum difference. 

Programmability: The capability of a system to change, to react to external 
stimuli (input) in order to alter its behaviour. Programmability, then, is a 
combination of variability and external control. 

Computational universality: Maximum programmability. 

Efficient programmability: Maximum variability changes reached in polyno- 
mial time (of a small degree). 

Efficient universal computation: Universality with measurable variations 
detected in polynomial time (of a small degree). 
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Notice how close this approach is to Turing's test for intelligence. This is a 
kind of generalisation of the Turing test: computation is what behaves as such, 
and it does so if it can be programmed. 

The following assertions follow (a technical paper with formal definitions is 
in preparation): 

• A system U is capable of computation if C™(£7) > for t,n > 0. 

• A 0-computer is not a computer in any intuitive sense because it is not ca- 
pable of carrying out any calculation. 

• A system capable of (Turing) universal computation has a non-zero C limit 
value (see Il42l0 . (A non-zero C value, however, doesn't imply Turing uni- 
versality.) 

• A system U capable of Turing computational universality asymptotically 
converges to limC™(£7) = 1 for t, n — > oo. 

The use of a general lossless compression algorithm is comparable with the 
role of an interrogator in Turing's test (see Fig. [2T2 ). To the compression algo- 



rithm the carrier of the computation is irrelevant as long as it can be represented 
in some form such that it can serve as input when running said compression al- 
gorithm. On the other hand, a compression algorithm is resource bound, in that it 
cannot implement in a finite time all the tests that can effectively detect all possi- 
ble regularities in the data. This means that the algorithm is somehow subjective; 
it will first resort to what strikes it as the most obvious patterns to use to compress 
the data. Yet the algorithm does this in a sophisticated way, with a greater like- 
lihood of success than a human compressor, as it is systematic and implements 
general methods. Lossless compression algorithms can also be set to run for a 
longer time to attempt more methods of compression, just as a human observer 
would devise more methods of compression given more time. 

So a system S is provided with a random input i (a "question") and the lossless 
compression algorithm evaluates the reaction of the system (then mapping the 
input i to a numerical value C(S(i)), the compressed length of S(i) using the 
compression algorithm C). Just as observers would do for regularity appreciations 
(or answer evaluations), different compression algorithms may retrieve different 
compression lengths of S(i), as they may differ in the way they compress. This 
compressed value is not completely arbitrary, as there is some objectivity in a 
strong desirable sense. This is because lossless compression is a sufficient test 
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of non-randomness, meaning that if a lossless compression algorithm C is able 
to compress S(i) then the Kolmogorov complexity of K(S(i)) cannot be greater 
than (C(S(i))). On the other hand, no C algorithm can compress S(i) such that 
(C(S(i))) < K(S) by definition of K, so the values of a compression algorithm 
C are not completely arbitrary (or subjective). 



Interrogator 
(lossless compression 
algorithm) 




Figure 2: The Turing-test inspired approach to the question of computation as a 
behavioural test undertaken by a lossless compression algorithm in the role of the 
answer evaluator. Notice that the natural system can be a human being or anything 
else. 



One may challenge the configuration depicted in 2.2 as lacking a true ques- 
tioner, given that the compression algorithm evaluates the answers but does 
not formulate the questions, meaning that the test, unlike Turing's, is not self- 
contained. This is a very good and legitimate point, but thanks to Turing, it is not 
very well founded. This is because from Turing we know that a system S with 
input i can be rewritten as a new system S'((S),i), that is a new system S' encod- 
ing S with input i. One can actually do this not just for a single input, but for any 
number of inputs, even an infinite number of inputs such as in an enumeration. 
Let E be an enumeration for S and pe the program that produces E (we know 
that the program exists by definition). Then S'((S), (pe)) such that S' behaves 
like S and uses p E to feed S with an infinite number of inputs (just as S for i, S' 
may not halt). So in some strong sense the system is neutral even to having all the 
questions at once or not. 
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3 A taxonomy of computation 



The measure proposed in 2J]can be used to dynamically define computation based 
on the degree of programmability of a system. The advantage of using the tran- 
sition coefficient C is that it is indifferent to the internal states, formalism or ar- 
chitecture of a computer or computing model; it doesn't even specify whether a 
machine has to be digital or analog, or what its maximal computational power 
must be. It is only based on the behaviour of the system in question. It allows us 
to minimally characterise the concept of computation on the basis of behaviour 
alone. 

Now we can attribute the property of computation to natural and physical ob- 
jects, hence arriving at a measure of Nature-like computation, and distinguish 
between the computational attributes of physical objects depending on their pro- 
grammability. 

Our proposal has many similarities to Piccinini's mechanistic approach, yield- 
ing a hierarchy of computing objects. But while he puts calculators and (specific- 
purpose) computers in different categories, I don't see any essential reason to do 
so. He places the concept of programmability at the centre of the discussion, 
as I do, but all in all our approaches are very different. His mechanistic approach 
doesn't seem particularly suitable for natural computation. At a more fundamental 
level, Piccinini's approach differs from this approach in that he seems to attribute 
importance to the physical implementation of a computation and to its physical 
components, whereas this is not a matter of interest here. Unlike Piccinini, I do 
not think that the property of computing is an objective feature of a system. 

A program can be defined as that which turns a general-purpose computer into 
a special-purpose computer. This is not a strange definition, since in the context 
of computer science a computation can be regarded as the evolution undergone by 
a system when running a program. However, while interesting in itself, and not 
without a certain affinity with our approach, this route through the definition of a 
general-purpose computer is a circuitous one to take to define computation. For 
it commits one to defining computational universality before one can proceed to 
define something more basic, something which ideally should not depend on such 
a powerful (and even more difficult-to-define) concept. Universal computation is 
without a doubt the most important feature of computation, but every time one 
attempts to define computation in relation to universal computation, one ends up 
with a circular statement [computation is (Turing) universal computation], thus 
merely leading to a version of a CT thesis. 

As Piccinini suggests in ll27l . a Turing universal computer, and indeed a hu- 
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man being, can do more than follow one algorithm. They can follow any algo- 
rithm, which is typically given to them in the form of instructions. "More gener- 
ally, a human can be instructed to perform the same activity (e.g. knitting or play- 
ing the piano) in many different ways. Any machine that can be easily modied 
to yield different output patterns may be called 'programmable'. In other words, 
'being programmable' means being modiable so as to perform relatively long se- 
quences of different operations in a different way depending on the modication." 

If everyday things like fridges or lamps can be deemed computational, then it's 
hard to see how any physical system whatsoever is not computational (this relates 
to Putnam's realisation theorem, see Subsection 4.2.6[ ). We can now meaningfully 



ask the question whether a lamp or a fridge is or isn't a computer, without trivi- 
alising the question itself or any possible answer. A lamp's output, for example, 
can be described by two different behaviours (in this case, traditionally identified 
as states), that is, on and off, which are triggered by external input (via a switch). 
Even if the lamp can be considered to react to external stimuli, it is very limited in 
its behaviour, and the space of its initial configurations is finite and small (it has 
only two possible initial configurations). Hence the slope of the differences of the 
behavioural evolution in time is very close to 0. A lamp is therefore a very limited 
computer with C value very close to 0. If one wished to rule out lamps or fridges 
as computing devices one would only need to define a threshold beyond which a 
system can be said to compute and beneath which it would not be said to compute. 
With a definition of programmability one can expect to be able to construct a hier- 
archy of computing objects (see Table[2]), with digital general-purpose computers 
placed correctly (at the top of the hierarchy of computers), while other objects that 
we may consider (non) computing objects can be found at or near the bottom. It is 
clear that the threshold is at the level of specific-purpose computers, given that we 
may want to include in the definition of computation entities that compute simple 
functions such as — only — the successor function, or the sum of 2 integers, while 
we may not be able to assign any computing capabilities to a specific-purpose 
"computer" capable of — only — "computing" the identity function. 

Brains and digital (Turing universal) computers can show great variation for 
two different random inputs, potentially even for two arbitrarily close inputs (ac- 
cording to same sensible distance of inputs), but for systems with low C this is 
different. For example, a lamp has only two possible "random" inputs: on and off, 
and the same number of outputs. For rock-like systems (including rocks them- 
selves), the rock looks the same disregarding the possibly thinkable inputs for a 
rock. Fig. [3] shows a rock- like behaviour of an elementary cellular automaton. 
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Table 2: A primitive hierarchical view of computation according to the first ap- 
proximation of computation based on the coefficient C with customisable thresh- 
old 5 is considered a computer if C > 5, otherwise it is not. The symbol ">>" 
is for systems for which (assuming they operate as they usually do, e.g. a fully 
capable human brain) no mistake about their computational capabilities can be 
made based on their degree of programmability approached by C. That is, their 
C" value is strictly greater than 5 for any 5 for t and n that are run for long enough 
(that is, long enough to be greater than 5). 

According to Piccinini, we distinguish computers from most other things be- 
cause, at the very least, computers are more versatile than other computing mech- 
anisms. He thus attributes a measure of positive versatility to the concept of com- 
putation (or the computer). "Computers can do arithmetic but also graphics, word 
processing, Internet browsing, and a myriad other things", Piccinini says. And he 
adds: "Computer versatility calls for an explanation" [1271 . Some objects, such as 
abaci, have parts that need to be moved by hand. They may be called computing 
aids, as Piccinini does. Of course abaci would have very small, if not zero, C val- 
ues with no human intervention, and therefore can be flagged as non-computers, 
even for small 5 threshold value. 

This account does justice to digital computers and the practices of computer 
scientists and computability theorists. On the one hand, digital computers, calcu- 
lators, both universal and nonuniversal Turing machines, and finite state automata, 
are examples of computation under the proposed definition. These can be recog- 
nised as computers, and universal digital computers can be placed at the top of the 
hierarchy of computational systems. On the other hand, the definition also places 
the concept of programmability at the centre of the practice of computer science, 
but through algorithmic complexity one can also define higher classes of compu- 
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Figure 3: Example of a "rock-like" behaviour by an elementary cellular automaton 
ll38ll with Rule 4 for several "random" initial configurations and evolving from top 
to bottom. The evolutions are preceded by an icon (top) illustrating the rule that 
the system follows for every possible cell configuration. 

tation based on Turing degrees, given that abstract machines that can solve the 
halting problem behaviourally perform a computation that cannot be carried out 
by a Turing machine that may not halt. That is, the oracle machine does halt, but 
it does not halt for every possible computation; it has its own new halting problem 
of a higher degree, and so on, hence building up the arithmetical hierarchy without 
need of explicit descriptions of states or functions. 

It is clear that computers are not the only programmable mechanisms. So 
are brains, as are many other natural systems that we can now control and direct 
to perform certain tasks that they were not supposed to be naturally capable of 
(e.g. through genetic engineering). A computer is a system that can be modified 
to compute in different ways. I think one, if not the most important features of 
brains and computers is that they can be reprogrammed (in different but analogous 
ways). Along the lines of Fodor's conclusion [fT4l . but with no need of state rep- 
resentation, if the brain is a programmable system, then it is a computer under this 
behavioural approach. This is paradoxical because according to Fodor's slogan 
"no computation without representation," according to which, in order for a sys- 
tem to be ascribed computational status, it needs to be construed as representing 
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information in some way. According to the view proposed here, we should neither 
reject or accept this dictum because a natural occurring process can be assigned 
a computational value if and only if it can be programmed, regardless of whether 
it represents anything. As pointed out by Dresner [?], a measurement-theoretic 
representation typically is accompanied by a uniqueness theorem that states how 
all the homomorphisms from the given empirical structure to the numerical one 
relates to each other (that is, can be obtained from each other). I will provide some 
clues of how to do this in the answer to possible objections in Section |4j 

Beyond formalisms, the present account of computers and computation is used 
to formulate a rigorous taxonomy. According to this behavioural approach, all 
Turing machines that compute a function other than identity are computers, and 
all that do so are universal Turing machines. It encompasses minds and computers 
while excluding almost everything else, investing minds and computers with a 
special status. One may think of some possible counterexamples. Think of the 
billiard ball computing model. It is designed to perform as a computer and can 
therefore be trivially mapped onto the states of a digital computer. Yet it is a 
counterexample of what the semantic account sets out to do, viz. to cordon off 
minds and computers (believed capable of computation) from things like billiard 
balls, tables and rocks (believed to be incapable of computation). The billiard 
ball computing model, as a system, however, is identified as computational in this 
behavioural approach, without further ado. 

4 Addressing possible objections 

Despite avoiding representationalism, which is one advantage of this approach, 
we find that certain objections to Turing's test, including some addressed by Tur- 
ing himself, can serve as objections to the behavioural approach to computation, 
and that possible objections to the behavioural approach to computation can also 
serve as objections to the Turing test. Nevertheless, we claim that the behavioural 
approach can provide useful tools for natural computation, and we will use it as a 
basis for a set of measures capturing different properties of the dynamic behaviour 
of natural systems, measures drawing on concepts from algorithmic information 
theory and compressibility. The objections are not thoroughly addressed here, 
as each may require a paper of its own, but I sketch some possible responses to 
explore. 
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4.1 Technical objections 



Let me first address some possible technical objections before turning to the philo- 
sophical ones. These and other objections deserve careful scrutiny, but there is no 
reason to address them all in depth here. 

4.1.1 The assumption that compressibility can capture different behaviours 

One assumption that the first approach to a definition of programmability makes is 
that compression algorithms are able to distinguish between different behaviours. 
From the proposed definition we derive the differences in the compressed lengths 
of the evolution of a system. But it may not be clear whether the length of the 
compressed version for a given initial configuration of a system can differ from 
the length of the compressed version of the evolution of a system for a different 
initial configuration that yields apparently different behaviour. The problem can 
be stated as follows: Imagine that one has two very different processes generating 
different data files, but that the lengths of their compressed versions using, for 
example, gzip, are the same. It may seem that our approach is suggesting that both 
processes are behaviourally the same, even when, apart from the coincidence in 
the compressed lengths of their respective outputs, they may in fact be completely 
different. 

K(s), however, is upper semi-computable^^; there is a sequence of lossless 
compression algorithms approximating K(s): Ci(s) > C 2 (s) > C 3 (s) > . . . > 
K(s). That is, one can find a sequence of compression algorithms that asymp- 
totically approaches K. K(s) cannot then be greater than the most compressed 
version of s. The invariance theorem flU in the theory of algorithmic information 
guarantees that the outputs can be distinguished from one another at the limit, no 
matter how close they are to each other, by a compression algorithm approaching 
K, and up to a bounded degree of precision (which can be large, but increas- 
ing t eventually overcomes it). More formally, the invariance theorem states that 
if Cu{s) and Cu>(s) are the shortest programs generating s using the universal 
Turing machines U and U' respectively, their difference will be bounded by an 
additive constant independent of s. 

It is easy to see that the underlying concept is that since both U and U' are 
universal Turing machines, one can always write a general translator (a compiler) 
between U and U' such that one can run either Turing machine and get one or 
another complexity value, simply adding the constant length of the translator to 
the result. 
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This means that eventually, if two processes are essentially different in the 
sense of algorithmic complexity, they will have different C values from some 
time t on up to K. The caveat that a system may be characterised in an imprecise 
fashion still applies, but the invariance theorem guarantees that the approach is 
sound theoretically, even if in practice it may sometimes be misleading, in a way 
that we are used to with compression algorithms that may not "see" regularities in 
a file (e.g. a file containing the digits of 7r). 

It is worth noticing that two different evolutions produced by the same rule 
system, such as a cellular automaton, may not necessarily have the same Kol- 
mogorov complexity (in fact it is unlikely they will if they appear different) be- 
cause the system in question is S(i) and not S alone, that is S for the initial 
configuration i (e.g. Rule 30 elementary cellular automaton |[38l starting from a 
black cell is a different system than Rule 30 starting from a repetition of ten times 
01). From Turing's universality, we know that S(i) can always be rewritten as S', 
that is a system with empty input that behaves like S for input i, where it is clear 
that S ^ S', and this difference is ultimately captured by the difference between 
K(S) and K(S'), that is the lengths of the shortest programs producing S and 5". 

4.1.2 The choice of enumeration of initial configurations 

The interrogator plays an important part in this Turing-based approach, which is 
why the initial input configurations are key — their role is analogous to that of the 
interrogator questioning the system. In general, one can always tamper with an 
enumeration E to make a system behave in a certain way for a limited period of 
time, as one can always run a system and then pick initial conditions for which the 
system behaves in a certain way, proceeding to design another enumeration E' for 
which the first E' t members are members of E but sorted from t = 1, n such 
that the system behaves in a desired way for the first n elements. So how sensitive 
to the choice of initial input enumeration is the Turing-test inspired approach to 
the problem of natural computation? One can make n as large as one wishes, but 
the limit behaviour of a system will always go beyond n. Does this guarantee that 
from some point on (e.g. n) the system will start behaving "naturally"? Imagine 
that one knew that a system behaved in a certain way for even length initial con- 
figurations. One could then design a E such that all initial configurations are of 
even length. But E has to reach every possible initial configuration in finite time, 
so there is no way to design E so that it would run all even length inputs and then 
all odd length inputs in a finite time. There is no way to fool the limit analysis 
of the behaviour of a system by tampering with the initial configurations for more 
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than a finite number of inputs. 

The general question of the appropriate enumeration of inputs for a system is 
worth exploring, especially for natural systems, given that it is not always clear 
what the enumeration of inputs for a natural system might be (questions arise, for 
example, about continuous-value parameters that may need to be discretised in 
order for a compression algorithm to analyse). One obvious problem is that of 
"encrypted systems". What if an efficient programmable computing system looks 
intentionally random and inefficient? Say one Turing universal system (e.g. Rule 
110 Il38l l6l0 behaving like another random-looking system (such as Rule 30 in the 
same rulespace). It is still Rule 110, but the question is whether one would be 
able to identify and program Rule 110 if it is behaving like Rule 30. It may be 
that one can only know it is Rule 1 10 if one knows the decrypting function, so 
the compression algorithm can be fooled. This is related to who can pass a "stu- 
pidity test", that is a system that is so smart that it knows how to look stupid, or 
to really is (one cannot pass, however, an intelligence or computation test without 
being intelligent or being able to compute. ). The question of "encrypted systems" 
occurring in nature is important to address. But this is certainly related to a fea- 
ture I think is desirable in this behavioural approach, that of observer-dependent 
subjectivity (Subsection 4.2.4) and to the question of the enumeration of initial 
conditions (Subsection 4.1.2) and the question of some sort of minimal need for 
representation (Subsection|4.2.1[). 



4.2 Foundational objections 

It is interesting to see how some objections serve at once as arguments against the 
Turing machine intelligence approach and this natural computational approach, 
while others do not (e.g. the Mathematical Objection (Searle [|32l , Penrose ||2"5l ) 
doesn't seem obviously to apply to the question of computation). Other examples 
are the theological and the consciousness arguments, which work against both 
machine intelligence and natural computation by endowing humans and natural 
things with qualia, which are said not to be concomitants of the domain of digi- 
tal computation. The objections work differently however, because in the case of 
machine intelligence they are meant to "safeguard" the essence of the human be- 
ing, endowing it with irreproducible qualities such as consciousness, while in the 
case of natural computation they work to "safeguard" the nature of digital com- 
putation. The advantage of my approach as compared to Turing's is that there are 
fewer people willing to defend machines than humans, though heated debates are 
carried out in both directions. The current tendency in computation, however, is 
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greater openness to the possibility that objects and systems other than electronic 
computers compute. 



4.2.1 Some representation is needed 

It is interesting to note that one needs some representation of the output of a sys- 



tem before feeding the compression algorithm (see Fig. 4.2.1 ). What about the 
introduction or the simplification of complexity in the encoding process from the 
language of the system to the language of a digital computer implementing the 
lossless compression algorithm? 

This is indeed the case, and it implies that there is some communication and 
mapping between the natural system and the digital computer implementing the 
lossless compression algorithm, but this mapping is of a very different nature from 
the mapping of states or functions among systems. Is this representation always 
possible? 

On the one hand, one can always discretise data. On the other hand we know 
that a discrete language can always be translated into binary. So in a technical 
sense this is always possible. This is related to the previous discussion of the 
question of whether a universal system could emulate a random-looking system 
to hide its programmability capabilities, and what this would mean. 
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Figure 4: What is the nature of the encoders? They work in both directions en- 
coding "questions" properly for each system, and feeding the lossless compression 
algorithm in the right format. Encoders A and B may be of very different nature. 
Simple encoders always seem a possibility, but questions about their implementa- 
tion and role remain legitimate. 

The proposal advanced herein is, however, different to the requirement of a 
strong form of representationalism, where knowing the states of a system to put 
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them into relation with another is needed, which is fully dependent on the com- 
plete (and unlikely) knowledge of the states of a natural system. Here, however, 
it is only needed a weak translation of one system output language into another, 
represented by the encoders boxes in Fig. 4.2.1 Encoders should not be seen as a 
drawback, we deal with them all the time in computing in the form of compilers. 
In systems development different programming languages are used for different 
purposes in different places of a system. Even if one can simulate each other as 
Turing complete, very few non-trivial applications today are fully developed in a 
single programming language. 



4.2.2 Programmability 

A second immediate reaction is whether placing programmability at the centre of 
a definition of computation is too strong as an assumption. For one may think of 
artificial and natural systems that may not look programmable, yet one would be 
ready to grant can compute (e.g. discrete neural networks). I think this objection 
arises from a conflation between the standard meaning of programming and the 
behavioural one I am advancing here. While it is true that for many artificial 
and natural systems a concept of programmability is difficult to determine, the 
concept of programmability advanced in this paper is about whether one can, by 
any means, make a system behave in a way other than the way it was already 
behaving. In this sense, for example, a logic circuit or a batch process may not 
qualify as a computation if these are unable to react to external stimuli or if the 
observer is unable to witness such an interaction if it happens in the design or the 
launch of a computing process. 



4.2.3 Human-machine and intentionality objections 

When Julien Offray de La Mettrie [|35l took Descartes' method to what he 
claimed was its logical conclusion in his L'homme-machine, the argument was 
that Descartes' attempt to defend the theory of a human soul by relegating me- 
chanical behaviour to animals in fact acted against humans. For if animals were 
capable of feeding, moving and interacting with other animals, strictly speaking, 
there was nothing to prevent human behaviour from being seen as a consequence 
of mechanical behaviour. In the Turing test we see a similar reversal of the argu- 
ment, where it is not the machine's intelligence that is questioned but rather the 
intelligence of the human being, not because the questioners harbour the suspicion 
that humans may not be intelligent but because the mechanisms that drive human 



24 



intelligence may turn out to be of the same order as those that drive computers 
today. 

Searle advances the problem of intrinsic meaning or "intentionality" ll32l . 
Harnad [16J defines it as the symbol grounding problem. I consider this objec- 
tion weak in our context (though it remains to be further explored), because if 
assumed, the definition of computation is rendered meaningless in the physical 
context (we know we can program certain natural things, these things would be 
considered computers when computing for us, and not when not). For the Turing 
test, some "intention" is desirable, as Turing is trying to convince his reader that 
there is no argument in principle for a machine to fail an intelligence test if it in- 
creasingly improves its performance when imitating intelligent human behaviour. 
Also it is clear that electronic computers, back in Turing's time as well as today, 
are assembled for the purpose of computing, hence no harm is done by assuming 
some intentionality. 

Dennett has suggested [fTTI that it would seem that explicit representation is 
not necessary for the explanation of propositional attitudes. For example, during 
a game of chess with a computer program, attitudes such as "It thinks that the 
queen should be moved to the left" are often attributed to the computer. Yet no 
one would suggest that the computer actually thinks or believes, in the way we 
do. I think it is clear how this behavioural approach to computation is compatible 
with this view, and neutral on intentionality questions, as it is only interested in 
the ways a system seems to behave and not whether it "really" does so (meaning 
it intended to do so, whether we are concerned with computers or with natural 
systems, including the brain). 

4.2.4 The observer-oriented objection 

One immediate reaction to, and a possible objection to this approach, concerns 
the applicability of such a behavioural (observer-oriented) definition, given the 
possibly arbitrary choice of S (see e.g. Table [2]). According to certain arguments, 
computation is observer-relative, either in the sense that many physical systems 
implement many computations (Putnam |[2~8l ), or in the sense that almost all phys- 
ical systems implement all computations (Searle PDO . Some physical objects, 
for example, may be seen to implement any computation of whatever complexity. 
Thus the walls in Searle's OTA , implement his wordprocessing program. Since the 
physical description of an object underdetermines its computational description in 
this way, computation is deemed observer-relative QTTl . 

This is of course a legitimate objection, which also applies to other behavioural 
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approaches to other notions, such as the notion of intelligence, and to the Turing 
test. I have suggested (Section 2. 1 ), however, that a measure of limit behaviour is 
possible, and that even if 8 is very large, one can always overcome it over time for 
systems that are indubitably computing devices according to the programmability 
approach (computers and brains), while one can always contrive to have trivial 
devices such as lamps and rocks not pass as computers, leaving a flexible space in 
between for systems that may or may not, subjectively, be considered computers. 

Its dependence on programming language or universal Turing machine has 
traditionally been considered one of the drawbacks of Kolmogorov complexity. 
In this approach we actually take advantage of this property of Kolmogorov com- 
plexity, as it assorts with a behavioural approach to computation that cannot but 
be observer-(or machine-) relative. This is because the Kolmogorov (program-size 
or algorithmic) complexity only makes sense once a universal Turing machine or 
Turing-complete language is fixed. On the other hand, because Kolmogorov com- 
plexity (K) is uncomputable (another commonly identified drawback), or more 
precisely, upper semicomputable, it is what the compression algorithm "observes" 
that approaches K that we will turn to our advantage in capturing the qualitative 
behaviour of a computational system in order to quantitatively measure it. 

Piccinini argues that any reasonable definition of computation should be ob- 
jective. I don't think, however, that this should be a sine qua non of a reason- 
able account of computation, nor that failure to meet this objectivity criterion 
makes an account vacuous or trivial. In fact I think computation is intrinsically 
user/observer oriented, both in practice and in theory. In practice, computation is 
mostly, if not entirely about programming systems. On the one hand, program- 
ming systems is intentional (driven by the desire to make a computer behave in a 
particular way), even if intentionality is not essential to computation. On the other 
hand, theory prescribes subjectivity in various ways. The halting problem can be 
read as an observer-relative property of computational systems, given that one 
cannot, in general, ever know whether a computation will halt except by running 
a system for a number of steps — which depends on the willingness of the observer 
to wait, if it doesn't halt before the specified number of steps. The problem is not 
exclusive to halting, but extends to reachability in general, that is, the question 
of whether a system will reach a certain configuration. Universal computation is 
subjective in the sense that one has to decide to stop a computation and deal with 
the fact that one may never know whether such a computation will ever halt or 
reach a certain configuration. 



26 



4.2.5 The halting problem prescribes subjectivity at all levels 

The halting problem is the problem of deciding whether a computation will halt 
or not. The halting problem implies that computations can be divided into 2 cat- 
egories: reducible and irreducible, that is computations that are simple enough to 
be determined to halt or never halt, and computations for which the only option 
is to run them and wait for them to halt, which may obviously take an infinite 
amount of time. Irreducible computations can also be classified into 2 kind of 
computations: computations that never halt and therefore not even running the 
computation will help and computations that halt in time t but there is no way to 
know t but by running the computation for at least t. Clearly this characterisation 
incorporates an important role of the observer in that there exists computations 
for which one can only know whether they will halt by running them, and intro- 
duces a subjective component, namely the fact that the observer has to decide a 
runtime cutoff that is willing to wait before making an informed assumption about 
the (non-)halting characteristic of a computation. 

Now one can see how an observer is important in the account of computation 
even for the most classical case of the unsolvability of the halting problem. This 
is even more evident when considering other phenomena, such as reachability, 
that is whether a computation will reach certain configuration, in which for some 
computations only an observer willing to run and witness the computation may 
answer. 

The undecidability of the halting problem affects all theoretical and practical 
notions related to computation. For example, in Kolmogorov complexity one can 
never say whether an object is random (one can say whether an object is simple 
if it has been compressed but not the converse). This doesn't make algorithmic 
complexity useless. In fact it is this observer-relative property (with respect to 
compression algorithms that may or may not "see" regularities in the data) that the 
measure is most useful — for all kinds of applications, including classification of 
animal species and languages by compressibility, detection of genetic sequences, 
fraud and plagiarism detection. In finite Kolmogorov complexity, finite random- 
ness is in the eye of the beholder, in the sense that any finite sequence can always 
be part of a random or non-random string. Hence the quality of being random is 
observer-dependent, just as it is in the case of the halting problem. 

I think that it is denying the role of the observer that makes the intuitive notion 
of computation vacuous or trivial. The observer plays an essential role in the 
definition of computation. This is made explicit in our definition of computation, 
for the purposes of generalising and characterising natural computation. 
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Under this approach, computation is observer-relative (in agreement with 
many authors who endorse computationalism), just as intelligence is observer- 
relative in the case of the Turing test. We find that certain objections to Turing's 
test, including some addressed by Turing himself, can serve as objections to this 
behavioural approach to computation (we will address some of them), and that 
possible objections to the behavioural approach to computation can also serve as 
objections to the Turing test. Nevertheless, we claim that the behavioural compu- 
tation approach can provide useful tools for natural computation, and we will use 
it as the basis for a toolkit of quantitative measures — based on concepts from al- 
gorithmic information theory and compressibility — capturing different qualitative 
properties of natural systems. 

Paradoxically, the behavioural approach does not explain a system's be- 
haviour, at least not in full, for we can explain part of a system's behaviour once a 
first behavioural analysis is performed, but not in the way we would be led to ex- 
pect if we followed Smith or Piccinini, for it is not intended to be a theory of com- 
puting, nor does it set out to fully account for the causes of a system's behaviour, 
only for its apparent behaviour. The approach proves to have applicability and 
to provide insight into the properties of dynamical systems about whose internal 
states one could potentially have no information, nor any clue as to the possible 
mappings between a natural and an abstract computational system. But it also 
works well for systems which we know and whose internal states we can study in 
full detail, producing all manner of mappings to other models of computation, as 
we have shown using cellular automata and the way in which the measures based 
on this behavioural approach allow us to characterise phase transitions or rates of 
information transfer from a purely behavioural perspective. 

Take the example of having to calculate the Lyapunov exponents of a natural 
system. Even if the system can be described as a dynamical system for which 
orbits can be described, this already assumes that one is able to represent such 
dynamics. Of course the behavioural approach also assumes that one can capture 
the behaviour of the system, but it does not assume full knowledge of the precise 
evolution of the system. In fact one can to some extent analyse a system in an 
instant of time without having to go through intermediate times (this will of course 
impact the final result, as it improves in direct proportion the more one observes 
the system). 

If the observer is essential to the definition of computation, one has to ac- 
knowledge that there is no sense to the most general question of whether the uni- 
verse computes, because no definition of the universe allows for external stimuli 
(external to the universe), nor for the output of the universe to reside outside it for 
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an observer to evaluate. 

4.2.6 Does implementation matter? 

The question of the implementation of computation seems not to have been taken 
seriously until critics of computationalism brought forward certain arguments to 
the effect that a great many physical systems implement many, if not all, com- 
putations. Such arguments have been presented by Putnam [28J and Searle OTA . 
According to Putnam (the eponymous Putnam's Realization Theorem), "for every 
ordinary open system S, for every finite state automaton M (without input and 
output), for any number n of computational steps of the automaton M, and for ev- 
ery real-time interval / (divisible into n subintervals) S realizes n computational 
steps of M within J". And according to Searle (what is sometimes called Searle's 
Thesis), "for any program and for any sufficiently complex (physical) object, there 
is some description of the object under which it is implementing the program." 

Along the lines of the question asked by Chalmers flU, what makes a rock 
compute something (or nothing) rather than everything? It seems that, at least 
prima facie, what (abstract) computability and (concrete) computation have in 
common is some logical description, only the characterisation of the latter isn't 
exhausted by a purely logical description, so implementation does matter. And it 
does matter in my approach, given that the rock may potentially be capable of any 
computation (think of using its particles to build a more programmable device), 
but it does not do so at the level at which it must be described as a rock, and if we 
look at it through a Turing-test inspired lens and attempt to make it behave in one 
way or another, i.e. program it to behave differently for different external stimuli 
(see Fig. |3]for a "rock-like" behaviour of an abstract system). 

4.2.7 Laws have no distinguished character 

It has been suggested ll24l that I am assigning a special status to physical laws, or 
to computer programs for that matter. This is an understandable objection but in 
fact it represents a misconception of my position. The misunderstanding resides 
in the conclusion that by connecting laws to computer programs as opposed to 
data, I give physical laws a special, immortal and unchanging status. Computer 
programs, however, can be written in bits. And, as I have explained in Section [L2| 
Turing proved that computer programs and data are not essentially different; one 
can always exchange one for the other. That is, it is possible to write the transition 
table of a Turing machine in the form of an input for a universal Turing machine, 
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or to build a transition table (a Turing machine) from the computer program de- 
scription. 

In algorithmic probability there is only one strong assumption regarding the 
distribution of objects. What Levin's universal distribution is supposed to indicate 
is the probability of a string being generated by a program, but one has to make an 
assumption as regards the distribution of programs in order to talk about picking 
a random program. And that is the only possible uninformed assumption-the 
uniform distribution. That is, any program of the same length is equally likely 
to occur as a product of chance. But apart from this one is free to interchange 
programs. There is nothing special about physical laws. They can be seen as 
highlighting or summarising a regularity in the data (the world), and data can 
change, hence physical laws may do so as well. 

4.2.8 The question of scale 

In the real world, things are constituted by smaller elements unless they are el- 
ementary particles. One therefore has to study the behaviour of a system at a 
given scale and not at all possible scales, otherwise the question becomes mean- 
ingless, as elements of a physical object are molecules, and ultimately atoms and 
particles that have their own behaviour, about which too the question about com- 
putation can be asked. This means that a C-computer may have a low or null C 
at some scale but contain C'-computers with C > C at another scale (for which 
the original object is no longer the same as a whole). A setup in which C < C 
is actually often common at some scale for any computational device. For exam- 
ple, a digital computer is made of simpler components, each of which at some 
macroscopic level but independently of the interconnected computer, is of lower 
behavioural richness and may qualify for a C of lower value. In other words, the 
behavioural definition is not additive in the sense that a C-computer can contain 
or be contained in another C-computer such that C^C. 

In the physical world, under this qualitative approach, things may compute or 
not depending on the scale at which they are studied. To say that a table computes 
only makes sense at the scale of the table, and as a C-computer it would have 
a very limited C, that is a very limited range of behaviour, for it can hardly be 
programmed to do something else. 

The behavioural definition is not immune to scale. Something may or may 
not compute at a certain level of description but it may compute at another more 
macro- or more microscopic level of description. But the concept of the object is 
also not scale invariant (we call things by different names when we change scale, 
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e.g. we call the constituents of a rock atoms, or the aggregation of H 2 in liquid 
form water). 

4.2.9 Batch process objection 

A batch process is the execution of a program on a computer without the need 
of any external intervention. This kind of system would go unnoticed by this 
proposed behavioural approach given the insensitivity of such a system to any 
external stimuli, as it is programmed to perform a task without interacting with 
anything else until it stops and produces some output, if any. During this time 
the process may look as if it were doing nothing, but this is merely appearance, 
and there are ways for the observer to ascertain that it is in fact computing, at 
the lowest level by its external resource consumption and release, such as energy 
and heat (which one could also manipulate to make the process change behaviour, 
for example, stop the process), and at another level, by monitoring the process 
for a long-enough time. The batch process instance is only valid as an objection 
between the time t = 1 when the process is actually initiated (it has to), and 
t = n — 1, because at least at one time t = or t = n (if it halts and produces an 
output) some interaction with the outside is expected to happen. So while some 
computers may fail to be identified by the behavioural definition, the limit be- 
haviour definition seems to be immune to this objection, except insofar as it may 
for all (proper) purposes consider something that may be computing as not com- 
puting because it is disconnected from the external world in which the observer 
lives. 

4.2.10 The contingency of quantum mechanics 

Using algorithmic probability (AP) S. Lloyd claims |[2"0ll : 

I would suggest, merely as a metaphor here, but also as the basis 
for a scientific program to investigate the computational capacity of 
the universe, that this is also a reasonable explanation for why the 
universe is complex. It gets programmed by little random quantum 
fluctuations, like the same sorts of quantum fluctuations that mean 
that our galaxy is here rather than somewhere else. 

(S. Lloyd, 2002) 
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We don't know whether AP can be adapted to a quantum version but we do 
know that there is no need for quantum fluctuations to generate algorithmic struc- 
ture [12J that Lloyd was trying to explain on the basis of quantum mechanics. 

The strong assumption in the context of classical computation and classical 
mechanics is determinism. The wave-function collapse in quantum mechanics and 
the problem of measurement may challenge determinism at two different levels, 
but otherwise classical mechanics prescribes determinism in the (macroscopic) 
universe. Classical (Newtonian) mechanics guarantees the deterministic output 
(the problem is to generate the same input). Running a computation twice with the 
same input generates the same output through exactly the same path just as would 
do a classical system following the rules of classical mechanics (that in practice 
this is not possible is due to the problem of limited accuracy of the measurement 
of the initial conditions). 

4.2.11 Connections to computational complexity 

In the light of this research now one can find an interesting connection of the 
measure C to traditional computational complexity where one is concerned with 
the needed resources for a computation to be carried out. C provides clues on 
whether a system may be Turing universal but not on whether a system may not 
be universal, because universality requires variability and sensitivity to external 
stimuli to program a computation. Also C is greatly influenced but not directly 
related to universality given that universality will guarantee that lim C™ = oo for 
t, n — > oo, but a positive value C does not guarantee universality, it guarantees 
sensibility which in this context is a measure of the capability of the system to 
be programmed to do different (even if limited) computations by transferring in- 
formation from the input to the output. But C ultimately depends on the way in 
which C is calculated for a finite number of initial configurations and a finite num- 
ber of steps, hence systems that may compute at a slow pace may be misclassified 
for some t and n small enough. C can be, however, thought as also measuring 
efficiency of a system to be programmed. So one can relativise this concept intro- 
ducing time complexity classes. So one can say that a system with C value that 
grows in linear time is efficient, but it is not efficient if it grows in logarithmic 
time. 



32 



5 Concluding remarks 



This paper has addressed the problem of recognising computation. It partially 
fulfils some of the requirements that according to several authors any definition of 
computation should meet (e.g. Il30ll . Il27l0 . while I have made the case that some 
properties are not needed and should not be required or expected, especially in the 
novel context of natural computation and artificial biology. 

Computational models can be very useful even when not every detail about 
a system is known. The aim of systems biology, for example, is to understand 
the functional properties and behaviour of living organisms, while the aim of syn- 
thetic biology is to design, control and program the behaviour of living systems, 
even without knowing the details of the biological systems in question. Along 
the lines of Turing's intelligence test, this approach seems to be useful for inves- 
tigating qualitative properties of computing systems in a quantitative fashion, and 
since it places programmability at the centre of computation it serves as a possible 
foundation for natural computation. 
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